TUM-HEP-621/06 
KYUSHU-HET-93 
|hep-ph/0603116| 



Twisted Flavors and Tri/bi-Maximal Neutrino Mixing 



Naoyuki Haba a , Atsushi Watanabe b , and Koichi Yoshioka b 

a Physik-Department, Technische Universitat Miinchen, 
James-Franck-Strafie, 85748 Garching, Germany 
b Department of Physics, Kyushu University, Fukuoka, 812-8581, Japan 

(March, 2006) 



Abstract 

A new framework for handling flavor symmetry breaking in the neutrino sector is 
discussed where the source of symmetry breaking is traced to the global property 
of right-handed neutrinos in extra-dimensional space. Light neutrino phenomenol- 
ogy has rich and robust predictions such as the tri/bi-maximal form of generation 
mixing, controlled mass spectrum, and no need of flavor mixing couplings in the 
theory. 



The fermion masses and mixing angles have been long-standing as well as inspiring 
problems in particle physics in these decades. Their observed patterns, particularly 
the recent results of neutrino experiments, strongly suggest profound principles such as 
grand unification and flavor symmetry lying behind the data. However flavor symmetry 
should be broken in non-trivial way while preserving the trace of symmetry structure. 
In this letter we present a novel way to realize flavor symmetry breaking in the lepton 
sector where a central ingredient is the global property of right-handed neutrinos in 
extra-dimensional space. Our method provides highly predictive, calculable effects of 
flavor breaking, and is also applied to the quark sector and grand unified theory. 

As a simple example of higher-dimensional theory, we consider a five-dimensional 
model where the standard-model fields including three-generation lepton doublets k 
(i = 1,2,3) are confined on the four-dimensional wall at x 5 = 0. Besides the gravity, only 
standard-model gauge singlet fields can propagate in the bulk Pjl] not to violate the 
charge conservations. We thus introduce gauge singlet five-dimensional Dirac fermions 
*$>i (i = 1,2,3) which mean right-handed neutrinos tp^ and their chiral partners. The 
Lorentz invariance leads to the general five-dimensional Lagrangian 

C = i^ihl'j - Wt m Di . vl', - 2 (r M i:j + h.c.) 

-(£my% + krn^) 6(x 5 ) +h.c, (1) 

where m, m c denote the mass matrices after the electroweak symmetry breaking, and 
the conjugated spinor is defined by ty c = r 3 r 1 ^' so that it is Lorentz covariant in 
five dimensions. The existence of four-dimensional subspace violates the bulk Lorentz 
invariance locally. If the fifth component of a vector field develops a nonzero expectation 
value, the five-dimensional Lorentz invariance is broken in the whole bulk and that could 
induce mass terms VET m|}\I/ , \P c r M \I/ but we do not consider such a possibility 
in this letter. 

Let us suppose the extra space is compactified on the S 1 /Z2 orbifold with radius 
R. There are two types of operations on this space; the reflection Z : x 5 — > — x 5 
and the translation T : x 5 — > x 5 + 27rR. They trivially satisfy TZ = ZT . On 
field variables, these operations are expressed in terms of matrices in the field space: 
Z(p(x 5 ) = Z~ 1 (f)(—x 5 ) and T(J)(x 5 ) = T^ 1 cp(x 5 + 2irR). The boundary conditions are 
then defined by the identifications Z(j)(x 5 ) = (p(x 5 ) and T(p(x 5 ) = c/>(x 5 ). In particular, 
for the bulk fermions they are explicitly given by 

Z = X z ®iT 5 , T = X T ®1, (2) 
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where Xz and Xt are 3x3 unitary matrices acting on the generation space, which 
satisfy the consistency relation XzXt = X^Xz- The ir 5 part is needed to make the 
kinetic term invariant, and it also turns out to forbid the bulk Dirac mass mo- Exactly 
speaking, the parity Z has an ambiguity of sign, but it has an effect that exchanges 
upper and lower components of a Dirac fermion and is physically irrelevant to later 
discussion. 

With a set of boundary conditions, the bulk fermions are expanded by Kaluza- 
Klein modes with their kinetic terms properly normalized: 

*^,* 5 ) = (£[<V)L,v4:V), £ [wt\ x %^(xny. (3) 

m n 

After integrating over the fifth dimension, we obtain the neutrino mass matrix in four- 
dimensional effective theory: 



= —-M^eMN + h.c, 



(4) 
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(5) 



where 



M Dmn 
M Rmn 
M L 
M n 



M c 



dx 5 wt )j d y W R n \ 
Jdx 5 W R m)t MW R n) , 
jdx 5 W^MW^, 



= mW R n \0), 
= m c W^\0)*. 



(6) 
(7) 
(8) 

(9) 
(10) 



The mass matrix M is written in the basis M = (el*, ip R \ eip^}* , ip R \ tip^* 



where zero modes are suitably extracted according to boundary conditions (e = ia 
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In this letter we consider S3 as an example of flavor symmetry group, which is the 
simplest non-abelian discrete group and has attractive features as the flavor symme- 
try The S3 group is composed of six elements which are the identity X\ = /, two 
types of cyclic rotations X2 3, and three types of permutations X^^. The non-trivial 
representations are doublet 2 and pseudo singlet lp, the latter of which changes the sign 
under a permutation. On the 3 = 2 + 1 representation, the group elements are expressed 
by the following 3x3 matrices 



1 



x. 



1 



x A 



1 



1 



Xa 



1, 



(11) 



It is interesting to note that possible boundary conditions for bulk fields are limited by 
several consistencies. First, since Z is a parity, available choices are Xz = -Xi 4,5,6- In 
addition, for the translation, Xt must satisfy the relation XzXt = X^Xz- Clearly 
not all types of boundary conditions are allowed; even in the case that Xz is trivial, 
Xt is limited to X\ 4,5,6- That is more clearly seen by defining another parity operation 
Z' = TZ, which is the reflection about x 5 = ttR. 

Now let us discuss flavor symmetry breaking with boundary twisting and character- 
istic consequences on neutrino physics. Throughout this letter, as an example, the three 
generations of lepton doublets and bulk fermions are set to be S3 triplets in which the 
first and second generations constitute doublets and the third ones are singlets. The 
first case we consider is along the line of the original Scherk-Schwarz theory jSj, that 
is, to have twisted flavors around the extra dimension: (Xz,Xt) = (1,X^) on the bulk 
fermions With this condition at hand, the mode expansion becomes (n > 1) 



W, 



(0) 



1 



R 



V2ttR 



(\ 



\ 



\ 



1 

73/ 



(12) 



/ cos (nf ) 
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-1 
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cos n 



2) Rl 
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V2 

1 
V2 



COS 



COS 



(13) 



3 



w. 



(n) 



1 



(14) 



^sin (n^-) \ 
_i sin [( n _ i)-J] ^sin(nf) 

The mass terms in the Lagrangian are generally described by two types of flavor sym- 
metric forms: the unit matrix / and the democratic matrix D where all elements are 
equal to 1; 

M = aI + -D, m = pi + -D. (15) 

3 3 

Another mass term m c is irrelevant in the present case since Xz = 1 and the lower 

components decouple from the standard-model fields [Wr^O) = 0]. Integrated out the 

infinite tower of bulk neutrinos, the standard-model neutrinos l{ receive the Majorana 

masses 



Mi 



\a+b\ 
a+b 



(p + r) 



D + 



H 2 

a r 



i^p 2 tanh(|a|vrii) 



6tanh(|a + b\irR) 12 tanh(|a|7i\R) 
\p\ \r\ 



F, (16) 



in a good approximation that <^ \a\,\b\ or l/R, i.e. the Dirac masses are much 

smaller than the bulk Majorana masses or the compactification scale. We have defined 
the integer matrices 



E 



-2\ 
1 

1/ 



F 



( 



\ 



(17) 



-1 1 



The obtained matrix Mi gives notable predictions of neutrino masses and mixing angles. 
The mass eigenvalues are found to be 

\P\ 2 



rai 



Ri2 



I"i3| 



2tanh(|a|vri?)' 

\p + r\ 2 
2tanh(|a + 6|vri?)' 

|p| 2 tanh(|a|vri?) 



(18) 



The current experimental status proves possible three types of mass spectra jHj; normal 
hierarchy (NH), inverted hierarchy (IH), and degenerate neutrinos. It is found that 
the latter two spectra are accommodated to the above mass predictions. (If a Lorentz- 
violating bulk Majorana mass were adopted instead of M, tanh is replaced with tan 
in the mass formula, and NH can be obtained.) For example, the IH case is realized 



4 



for a small bulk Majorana mass (\a\R -C 1) and suppressed democratic couplings b 



In any case, one has almost no need of generation mixing couplings both in the Dirac and 
bulk Majorana mass terms in order for the mass eigenvalues being acceptable. The mass 
hierarchy structure is also interesting. In usual case, the smaller heavy-field Majorana 
masses, the larger induced light neutrino masses. However we have found in the above 
the eigenvalue 771,3 has an opposite behavior: a smaller bulk Majorana mass (\a\R -C 
1) rather suppresses induced mass (711.3) than usual. This is because such eigenvalues 
come only from heavy excited modes which are decoupled in the limit |a|i? <C 1. Such 
unconventional behavior is useful not only for generating tiny neutrino masses but also 
to discuss some neutrino physics in cosmology. Contrary to wide possibility of spectrum, 
the neutrino mixing matrix is definite and given by 



where P is a diagonal phase matrix. This form is often called in the literature the tri/bi- 
maximal mixing [7][H] with the prediction of mixing angles #12 = sin _1 (l/\/3) — 35.3°, 
I #23 1 = 45°, and #13 = 0°, which are in excellent agreement with the latest neutrino 
experimental data 9 . Also, CP is conserved in neutrino oscillations. A remarkable 
point is that the generation mixing is not affected by any detail of mass spectrum 
and model parameters. Furthermore it is also independent of boundary conditions; the 
tri/bi- maximal mixing follows for almost all types of flavor twisting which are allowed by 
the consistency relation XzXt = X^Xz, while the mass eigenvalues are full of variety. 
Therefore the mixing matrix (|19|) is a robust prediction of the presented mechanism. 
The Scherk-Schwarz theory of neutrino flavor provides the observed mixing pattern 
quite naturally. 

It is enlightening here to discuss how the tri/bi-maximal mixing is derived in our 
scheme of flavor symmetry breaking. In the basis where the weak current is flavor blind, 
the light neutrino mass matrix A4/ should take the form 




V = 




P. 



(19) 




(20) 
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where the mass parameters with primes include Majorana phases. It is immediately 
noticed that several integer matrices must be realized and so highly correlated mass 
couplings are required to have the tri/bi-maximal mixing. For this purpose, some explicit 
models have been elaborated |1U| . In addition, the mixing matrix V seems difficult to 
be obtained from a viewpoint of flavor symmetry (breaking). To see this, it is relevant 
to rewrite Mi as 

Mi = l 2 3 I+ 2 3 l D+ x 2 3 X 4 . (21) 

The first and second terms preserve the S3 flavor symmetry, while the last term breaks S3 
down to S2 which acts as an exchange of the second and third generations. To have the 
last term of symmetry breaking is a key ingredient for the tri/bi-maximal mixing. There 
are two awkward implications of this desired form of .M;. The first is the magnitude of 
flavor symmetry breaking: the last term in (|21|) becomes a dominant contribution for 
any type of allowed neutrino mass spectrum. It seems unlikely in usual model building 
that symmetry breaking parameters are larger than symmetric ones. In our scheme, 
the decoupling of many heavy fermions amplifies breaking effects. Another problem is 
the pattern of flavor symmetry breaking: the last term in (|21jl is not general for the 
unbroken symmetry. The most generic S2-invariant matrix is 



(22) 



Eq. (|21|) indicates that a special type of flavor symmetry breaking, 7 = 8, is required 
for the tri/bi-maximal mixing. If 7 ^ S, the 1-2 mixing angle falls into being outside 
the experimental range: a small difference I7 — 5\ gives a big effect on the 1-2 mixing 
angle (and the other angles are not modified). This behavior comes from the fact that 
the prediction of tri/bi-maximal mixing has no relations with mass eigenvalues. The 
experimental bound on 1-2 mixing implies |l - || < 0.12 (Am^/Am^) 5* 1 < 0(0.01), 
depending on the neutrino mass spectrum. The relation 7 = 5 must be therefore exact 
but does not seem to follow from any symmetry argument. We have discussed that the 
necessary form of mass matrix is highly complicated and also technically unnatural from 
a viewpoint of flavor symmetry (breaking). The right flavor-breaking effect is readily 
available in our five-dimensional theory of flavor with boundary condition twisting. 

Most types of boundary conditions are found to lead to the mixing matrix ((T§)) . The 
general discussion above suggests that a possible deviation from the tri/bi-maximal 
mixing appears in the case that flavor symmetry is completely broken. Among the 
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boundary twisting allowed by the consistency relation, there exists only one type of such 
exceptional twisting on bulk fermions; (Xz,Xt) = (X±,X2) [or physically equivalent 
one (X4,Xs)]. Fourier-expanding the bulk fermions, evaluating mass matrices, and 
integrating over the extra space, we find the following Majorana mass matrix for three- 
generation light neutrinos: 



^p 2 sinh(2|a|7rit:) 



Mi 



D + 



6tanh(|o + 6|7ri2) 12 cosh(2|a|7ri?) + 6 



E 



|f|P 2 sinh(2|a|7rii) 



F + 



pp 



4cosh(2|a|7i\R) + 2 4 cosh(2|a|7ri?) + 2 



G, 



(23) 



where m c = pi + ^D, and we have defined 



G 



( 

1 

V- 1 



1 -\\ 



1 J 



(24) 



The last G term does not preserve the previous S2 symmetry (the 2^3 exchange), 
and the tri/bi-maximal mixing is expected to be modified. It is noticed that G has 
another S2 invariance (1 <-> 2 or 1 <-> 3 exchange) if suitably combined with D, E, and 
F. This indicates that the flavor symmetry has two breaking sources, i.e. the non-trivial 
local twisting at x 5 = (Xz 7^ I) an d x 5 = ttR (Xz> j^I,Xz), and flavor symmetry 
is entirely broken only globally. In an approximation that S2 breaking (the G term) is 
sub-leading, the neutrino mixing matrix deviates from the tri/bi-maximal form as 



V = V 



V 



p' = 



V2 



1 

V3 

1 
V3 

1 

V3 



2e_ \ 



-1 e_ 

1 

v 7 ^ V6 



P' 



(25) 



with a small parameter e = \/3cj/2(1 + |w| 2 ) sinh(2|a|7ri?) where a; = |a|p/ap. Unlike 
the previous case, non- vanishing, complex- valued 1-3 matrix element is generated. This 
implies the mechanism simultaneously generates CP violation as well as flavor symme- 
try breaking. It should be mentioned that the parameter e cannot be made real by 
field redefinition; even if lepton doublets are freely rotated, a combination lo contains a 
unremovable physical phase degree of freedom. 

The corrections to mixing angles depend on the neutrino mass spectrum. We here 
examine the NH case, and the IH is obtained by simply exchanging mi <-> 1713 (and 
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a <-> a* , p «-> p). The mass eigenvalues with NH become 



d 2 sinh 2 (2\aWR ) + f 2 , , 

mi ~ tVt / — , (26) 

1 1 2cosh(2|a|vr J R) + 1 ' v 7 

\p + ?"| 2 

|m2 ' = 2tanh(|a + 6|vri?)' (27) 

|p| 2 sinh(2|a|^) 
|ms| " 2cosh(2|a|vr J R) + l' ^ 

with |p| <C \p\ tanh 2 (2|a|7ri?). The smallest eigenvalue mi is found to receive an SV 
breaking effect in the case of small Major ana mass (\a\R <C 1). The neutrino mixing 
angles are controlled by only one parameter e and have rather definite predictions. First 
notice that, even if the couplings in the theory are exactly flavor blind (6, r — ► 0), 
one can obtain sizable generation mixing of low-energy neutrinos as well as realistic 
non-degenerate mass spectrum. The 1-2 mixing is still given by that of the tri/bi- 
maximal mixing, similar to all the other boundary conditions (612 — 35.3°). There- 
fore this is a robust prediction of our scheme for flavor symmetry breaking. The 1- 
3 mixing angle is small; #13 = |"^? e |- F° r a small bulk Majorana mass \a\R -C 1 
and with flavor-blind couplings, a predictive relation among the observables is de- 
rived; sin 2 #i3 = ^(Am^/Am 2 ^) 1 / 2 . For a larger Majorana mass, the 1-3 mixing is 
suppressed by sinh(2|a|-7ri?) and would not be in detectable range in future experi- 
ments. The low-energy leptonic CP violation is determined by the complex phase of 
e parameter (</> e ), which is the only one unremovable phase in the lepton sector as 
stated above, and may also be concerned with other CP non-conserving phenomena 
such as baryon asymmetry in the universe. Finally, the 2-3 neutrino mixing is given by 
tan #23 = |(1 + e/\/3)/(l — e/\/3)|. Interestingly, the deviation from the maximal mix- 
ing is related to the Dirac CP phase as cos 26*23 = — V% sin #13 cos 4> e . For the minimal 
CP violation, that means 6° < | ^23 — 45° | < 8° for NH, and is comparable with the 
current experimental bound. On the other hand, the maximal CP violation implies the 
maximal 2-3 mixing. The effective Majorana mass for neutrino-less double beta decay is 
|(m ee )| — I m2/3 + 7T7-3 sin 2 #13! < 10 -2 eV and would be accessible in future experiments. 

The whole charged-lepton sector resides in usual four-dimensional (boundary) world. 
We here present an example of charged-lepton mass matrix with which the observed 
lepton mixing is dominated by the tri/bi-maximal mixing. Similar or more reasonable 
models might be available in a variety of scenarios which have been discussed in four or 
higher-dimensional theory (though, in more than five dimension, some regularization |12j 
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is needed to integrate out heavy modes). Our illustrative example introduces a flavor- 
triplet neutral scalar <E> in addition to the right-handed charged leptons and Higgs doublet 
which are flavor singlets. The charged-lepton masses come from the operator involving $ 
with relevant symmetry imposed. If flavor-breaking expectation values (<&) = (/i, /2, fy) 
with fi <C /2 <C /3 and no flavor structure (possibly as well as the neutrino sector) are 
utilized, the charged-lepton mass matrix becomes 

/ Xl x 2 x 3 \ 



yi V2 y3 

\zi z 2 Z 3 J 



(29) 



with Xi <C yj <C Zk- This induces tiny corrections to the exact tri/bi- maximal mixing; 
<5#i2 ~ SrS SO23 ~ ttt" 1 an d ^^13 ^ 1- An application to the quark sector is straightfor- 
ward. A similar and realistic hierarchy is obtained if the triplet <E> accompanies with the 
right-handed up quarks and the quark doublets (or only with the right-handed down 
quarks), which may also be realized by symmetry argument. 

To summarize, we have presented a framework for breaking flavor symmetry with 
Scherk-Schwarz twist and for communicating it to low-energy effective theory by inte- 
grating out twisted variables. As an application, the S3 flavor symmetry in the neutrino 
sector has been discussed and found to provide rich and robust phenomenology such 
as the tri/bi-maximal generation mixing. Other possibilities including quarks, grand 
unification, and cosmological study will be investigated in a separate article. 
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